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[Ai#9] i|^ft£!Ai 

[gaps] mtt 
mmmm 2000.09.22 

ir^£2K □ Jlir ^£011 crjg 2^ tdlCIS Jlir 01 01 a 

SurSiJ] A Video Summary Description Scheme and A Method off- m 

Video Summary Description Generation for Efficient 
Overview and Browsing 

[ ft £] m E ] 3-1 998-007763-8 
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[^§A1] 
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[^BJg^fflsl 670104-1691416 
302-122 

l^±] QKS^^AI ^6!2S 912SXI ^XIOHttM 110§ 4052 

[^31 KR 

[gS°l SSS;i] KIM, Jin Woong 

[^EJs^Ss] 591223-1011621 

[<=>ffiujs] 305-390 

l^±] CHSS3AI 2 El# 2«±50HIFM 305-1603 

i^m kr 

[IS^S] KR 

[iSiW] ^ 

[ISiat] 10-1999-0043712 

[£§!S!XU 1999.10.11 
[§§A1W] 

mm mms iu2?e°\ ^soii a si, «m xii60£°i 

Oil 2I& iSI^AI ■ g^tHJCh CH E.1 2J 
2§i (2J) 

PI^SSI^] 20 ffl 29,000 SI 

17 a i7,ooo si 

! a 26,000 SI 

[^jAFS^S] 32 § 1,133,000 SI 

imm i,205,ooo si 

615,500 SI 

[§¥Ai#] 1. S^Ai-SA1IAi(ES)_1S 
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[ASH] 

^*Rr v]r)o_ ^ ^ oi^ tilw] Tflo]^ ^ 7l^# 

7l^2:(HierarchicalSummary DS)^, S>4 ^H^ 0 ] H 3]! *7]^2: 

(HighlightLevel DS)# If^fJl -3-^HMl5^J= 7l#^(SummaryThemeList DS)1- ^ 
3-°^ if-W. ^71 ^H^HSefllS 7l^^fe ^H^°l Sell ^(HighlightLevel)^] 
tfl«fl 7l^srH, <^7fl JEfe 4^r7fl^ SH^HS^ 7l^Sl- 7>^ ^ 

^ol^-olEe)!^ >]#^2: (HighlightLevel DS)tt 31 is] 3.°}= o_s. zj- 

(HighlightSegment DS)-& i^nf. ^H^H^- >*fl^dM 7}^^-2i^ sfl^ ^Izl^e 

^iLl- 7)^}7) *]t\$_ ^Ih^e <$x)t]^ 7l#^S 
(VideoSegmentLocator DS)1- S^-^cf. SE^h ^>^]efo]E ^zl^M 7}^^ sfl^- 4 
h^eo] cfl S ^.g. 7 ]#^>7l ^ 7)^S(ImageLocator DS)4 

^3. ^ 3iL« 7l#^7] ^ 3*1*13 7l^2:(SoundLocator DS), ^ 

(AudioSegmentLocator DS)1- SL^tt $14. 
2. 2 
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ofs jl^ til^^. 7l# ^ a Video Summary Description Scheme 

and A Method of Video Summary Description Generation for Efficient Overview and 
Browsing } 

£ l£ 4€- ^^(description scheme: DSH1 -2.^ «14-2. 

£2fei 4^ -8-*j= ti]ti|^l- 7l^^>7l W 31^3 7l# T^-iL^S 

# UMLOJnified Modeling Language)^. S^ltr 
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[1^4 ^1 

1^4 ^Rr 4 #£-4 ^ ZL £44 ^Sfl7l#] 
<5> £ ^ o. j^^oj til^^. ^ W-S}-f ^^r 4^ -2.4 44^. 7l#^2^1 ^ 
m 3W4. ^ ^.oi: n]tq o. 71^^] uq-ef ii_4 44.2.1- 71^44 4tt -2-4 44s§- 
^ 4^4) ^ 344- 
<6> ig^oj 7i^«o]:^ 44-2- ^qo]( indexing) ^ j±4-f^/;g4 

£45. 44-2-1- vfl-g-71 content based) °-5. .2-44:2. 4« 4#4^ £444v ^.4.. 

^.1- -2-44^ H7fl ^4 .8. 4 (dynamic summary)^ ^4 -2.4(static summary)^ • 

5L 4^ *r 5^4 £ 4^ 44-2- 7l^Sfe ^3 J144 33 ^.^4- ^^ . 

4 #4 7l#^S. 14^]^ 4 #44 4?t 344. 
<7> ^tiV^o.^, 7^4 .2.4 u]v]SL ^ 7l^Sfe #£4 .2. 4 tiltqo,oj] if-sj 

-2- 4tt 4^-2-5-4 ^.^ t!]^ 0_o) ^o. ^ y.j.^o)- xij] 

^dt^t| 4^4. ^34 34- -2-4 44-2-1- ^A-] X^j ^.g-g- 7]]^- 

4^1 ZL^]7l^4^ 4£4 7fl^ ^44 ^ ££^44 4^44 44 

«-4-t-^ 1o 1 ^-2.44. 

<8> 2E.*> 7l$S] 44^ -2-4 44^- 4^4 jj]^ ^^.^>Ufjl 

44^- 4-8-*Hl7fl *H^4. 444 4-8-44- 44^- ^44 4 

^4 4# 34, ^ 4-§-47> ^14 €*Rr 4^4 5^ ^ 4-§-4±r ^4 
4 -2.4 44-2.1- ^ Si 4. ^, 4^4 -2-4 44-2-fe Si 7>4 5fl*§4 -2-4 44 
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.2.7} 41^51^ A}-$r*}7} Q*}^ til^l^l- -id^-SE^- ^1°} JL9} a]^^.^ 

^-g-41 4€- ^ ^ S^o S A}.g-^ ^Bji ,3^7} X)^o]ti.. 

> ^^^1 ^^ 1o ] 'method and apparatus for video browsing based on content and 
structure' <>luL ^ »Ul7} US5821945 91 ^-^H^ v)^^ #^1 zl a 

^ f-^H €*Rr altq^s. ^esRr «-S}^ afl^t}. nsm tfljE-. 

.,-§: °l-g-*H A^Kr^, tfla 3*1 ZL ^ tfl£?Hr 3iL# *\}^}E.£. 

5} ti.H}^l a o V^ o. >*fln^iH6fl ^ ol^t}. 

>s 1999^°)} I SO/ 1 EC JTC1/SC29/WG11 MPEG-7 Output Document No. N2844 ^ ^5.^.' . 
MPEG-7 Description Scheme (V0.5)' <*1H 2fl°t^l ^± 7]^^ ^ 

7]^ ^^1*} 4^ 7l^lfe Wl^* 

&t}. a, Jl*} ^ 7fl « ^-g-^r # ^ ^Hif 

SEt} £.*} 7l# 7l^ ^R^l 4*1^5. 4£ 7lW}5l 

(event-based summary) S^JI*} *} nfl 7l#nf M-^ol ^7}^^^^ 
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til^^ ifl-g-ofl ^-£-^(user customization)^ 

7lti> £.3} (event based summary)*)- J±eHM)-i: 7pg^}7fl S}^ 7j]^*] 



tM3 ^ 

><12> Ol S.^^. ^*>7l ^ £ ^ .^Al^oll rcj-s. y^^^Ol 

7l#^-S(HierarchicalSummary DS)^, SM^H 5 - $}*go\) tfltj) 7]#^ 3<H3E. 
#3 *H SHEA'S 71^2:1- £f-^-JL, #7] ^>o]e)-o]Eefl^ 7}<t^±r ZL 

e^Izl^e 7]^^2;(HierarchicalSegraent DS)# S^*!: 3J-§- ^$£.3. ^tj-. 

<13> °^^7fl^ #71 SHBHJMig 7l#^S^ Cf^ 7fl2l ^ *M o] E ^ ^ ?1 

<14> o^j-^^- ^.7] ^ol^olE^^L^E 7l#^2:^, ^7} ^ f>\o)^o)^ ^ZL^E 
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<15> ^JL^Tflfe #7} 7jl#*U^ 7l#^S^, ^-71 Tjl^^il^ 7 j ^3,7} ^t}^ 3. 

s. &oio) ^s.^. 144^ SummaryComponentType-ir 4*1 7}^ 
SummaryComponentTypeList #^^r S.^^: 3l^g- f^'AS 1*4. 
<16> ^7} 7\]^£.<$ 7l#^Sfe, Jl^Hl 4£(3^ ^^1)1-^ M-1 

^fjl n IDS 7l#S>^- ^.^^jel^E 7]^S(SummaryThemeList DS)# Sf-^H , 4 

£ 7l^fjl A]~g-*}7> J3-4 #7] ^.^^l^^Eojl 7}<t& 

H^r A>^^^ ti^-f^i^ - ^ 3^ ^4. 

<17> SE^b, 4^ 7jl#^^.^ 7l^SS 4^ ^"ff 

^ ol^ 7l^-Pfl^7} ^£4. 
<18> £ ^ofl 4^ ^^^1- J9L$J= 7}^2,o\) 444 yjti) 

* iL 7l# 3H41- ^*Kr JS-4 4^-2- 7l#cflolEi M^o] ^S}^t]], oj^ 4 
4^-1- £-4*H £4^41" #^4^ B)€\o_ £4^14; .2. 4 44.2. 

- ^-^M: ^i^^>7] 4t!r fl-4# ^sl^Kr -3.4^*1 ^4^31; #4 ^ -443. £4 

^44 #7] J5_4 ftz\£ «g^^O> ^ 44^14 j^t- ^ ol^ 44_2. 

^^Rr -2-4^ ^^i^^l; ^ #7] A 
oil 44 44.2_.2_47l#c)H41- j^l^-M^Tfll- i^-*H 3 

-2. 4# Z\}o)B\Wr s§s§is}±r -&4 7]£ 3H4 ^4^1, o]^ 

°J ^ ^ £4*H wl^A £-4^41- i^Hr ^14-2. £4^3:4; -Q-^ «1 
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3R> JBL^= fl-*]^ 33*Hr Jl^*i ^S]^; #7l ^ tijc]^. 

£ ti>^ ^.ot ti ]c]^ 7l# Ti\}°)B\ *$^^0-5. 

Tflf^-S-^ 7l^^^l 7l«>^H -8.9= 7]^ Cflo]^)!. 

^ #7] ^ ^.SJ: H]c]^. 7l# C-flolE^l- Blc] Si C-j] o] E-) $ 

#7] 7l# dlolE^l- o]^S>o^ #7] ^ H]^*- 7fl^l-Jl >J-7l *\V]<!\ 

°l*h ^£ ^ ^^1^1- -M^tH ^^^4 



£ l£ t^efl 4^ 7l#^-3:(description scheme)^ ^-^H 33-2- 3# 



1020000055781 2000/10/2 

4-E *14-2- 7l# ^ ^ ^#^(101), 4£ 3t°f 

(102), ^3) iS. 3 #^(103), JGL^f ^^4(104), J9l^= ^ ^^-(105), 

tflS. ^31 °J ^#^-(106), tflJE. ^ ^#^(107), ^ Jief B14-2. 7l#Jf (108)3. ^ 

<25> s^i ^#«-(ioi)^ ^ «14.2.1- «g^*H 
- ^#t>4. ^#3^ -ip^^b # ^A, ?H14 

-3' &4. ^K 1 ^# ^HHfe <>m ^« ^#*H ^3 °m ^ - 

##£j^r «14£ Al^> (m^i ^= ? Al^^)^ ^Efl S A> 

3 3# #^4. <» ?H14 ^ (?H14#, 1, 100~150)o)l - 

^ ?H14 w #H 100-150 S^]^^^ 3#sqS4^ 3E^4. 

<26> 4£ ^#4(102)^ ^ 5E^£ ^-2- ^#*>4. o]S. 

nfl-g-ofl o^tiV^ O.S. ^ #Hofl 4^.4 q-s.7fl 3^34. *>3<8r 

$14. <« 1-^, ^t 1 h]4£3 7fl7fl^(replay) ^ 4£-°3. 3 

^ 5U4. 

<27> A}£ ^#-^(102)±r 3<t^ ^ = ^ -2 Al ^> f^. f A^WlJr, 

^) #3^4. ^11- §^ #*fl 200-300 4°H 

^ a}3 ^ilb (#, l, 200-300) s] ^Bfls. #^t!:4. 

<28> iSliH ^#^-(103)^ A>^^- 4^-0.3 «14^-« °l°>7l 7l ^ 
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^ Wlc]^oj 3 o_ ^ A] .^ ol 5,^ ^ ^ A} ^o_^ # o]ul- £oj 

^«^r wfl^l -&f^ ^ f # ^efla.^ # #^<5] 7fl7fl^- ^o] zl 

^tfl ^ ^ f^vo o.^ oflsi^* ^^.q.. 

<29> ^iL^ Hl^ihJE WlJl, Al^> ^^>, -fAj £o^ JL;g A^ Af^ a)^ 

- -^iL)3 ^Bfl^ ^7^ o]|3l]i:H #JL^ i^iEO] oJ£ ^oljl ^ 

ZL ofliq^HS] A)^> ^>-g- At uj-Bl-^Cf. ^-Aj £<fli=. ^ oflS]^^ ^ 

^11- (oil ^iHl, 4~6, 1, 5, # 1, *}^3)°-5. g_X\-Q ^-f f ^ 

i^^H^ 4~6«]*I) if-^Jl, -f^i ^Jl(l), ^ 5«1 ^laL 

. .-.ol^E^ it£ -gjzj. 3 a] ^Bj-o]^- uful-^rl-. 

<so> _&oi: wiul^ ^ AjEjjH.( 104 )i- 3^s} oil ni ^ tilu) o_ ^-g~g- ^ 
-S-^ ^r °1 ^ 7l^-£r His] ^^^1 iL^ ^ • 

^^^(105)^ SL<* ^^Hl 4^1 

<31> ^ ^oja (105) o]lA^ ^.ot AjEfl^l 3^ ^^}JL ^ 

^^}7] W ^H^IM #^ £^ -8.9= ^^(105)°lHfe ^.ot h| 

3-2. ^M- ^d^^^l 7ltiVol Sl^ 43 fHTl- ^ Hlc]iL 7l#^-(108)S. 

<32> ^.ot u|u]^ ^ AjEflH.( 10 4)^ AjBfl^ ^.of tijul^oj ^Vl-oj Al^V ^^.1- ^511 
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<y r&$\3. t^JI v]t)± n^is}^ a}£ ^^-1- #3^4. ^, (100-200, 

(500-700, ..... ^ ^Efl^ Hit] .2.31 ^l}£-3- ^Izl^e^ 
100-200 HBfl<y, 500-700 = iifl<y ... o]JL 4 ^zl^eo} aJ-^o. §4 ^oj^g- uj-Ef^uf 

<33> ^.ot ^o] ZL _g_<* ;$j£.g. oj-g-^ ZL «1 1\ 

sl ^HH^i flia ^5il 0 J4 cfl^ tfla ssn°j ^#^-(106)^ t^s. ^ 
^#^-(107)^1^ -^W. tfls. ^#^(106)^ a js.^ cfl 

. s*Rr s.^ 5Efe ZL C-]lc,]Bll- #3^4. tfla ^#^-(107)^- 

H iL^ u lr q^ cfl^Rr ^ cflolEl Sfe *}Zt ^ll^r #3^4. 

<34>^ u]t)± 71^(108)^1^^ £ 2^1 7l#£ £ ^ofl 31^3 7l^S 

(Hierarchical Summary Description Scheme) ^ 44*1 JL^f^^I -3-44 tL4-f^) 7)^o) 
7}^-&}S.^ ^ ^^.1- 7l#*>4. ^7H1 Sf-sl^- ^JULfe .£-4 4 4 -£-4 ^ot 
4£ ^fr4 4 -2-4 44-2- 7l^>^ 4# >g^. f tflJES^oj, tfliE 

, 42 ^J±#<>14. 

<35> ti]^ C_ 7l#^-(108)^ £ 2«fl 7] #^o]j u}-^ ^ tijt^ 

4# 31441" 

<36> £ 2^ £ ^6fl 4^ -2-4 44^ 4# cflolEil- 4#44 4^ 7^3-2-4 4# 

^S(HierarchicalSummary DS)4 x}3.^-£.^ UML(Unif ied Modeling Language)^. 
?H4. 
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7)^}^ 7\}^&_<* 7]#^3E:(HierarchicalSummary DS)(201)fe *} 
4 ol#s] SH^H^! 7l^2:(HighlightLevel DSX202), ^ SEfe 7fl^ 
^MI^e 7l^2:(SunimaryThemeList DS)(203)S ^^4. i^T^il 
(SummaryThemeList)fe ^M^fe nMl SE^ M-I^H 7]^]-^ ^o. 

3- ysj-o^i 71^-i- >fl^cf. 

SHeH^llS 7]#^(HighlightLevel DS)(202)tt zl JL*$ *]t\$L^ zfr 

*]k\SL -z.# ^n>a^ ej-ol^ojE^-L^E 7]#^2:(HighlightSegment DS)(204) 
4 ^(zero) ^ 4^11^ sH^ojE efl^ 7)^2:(HighlightLevel DS)S ^£4. 
High light Segment DS^ .8.^ wl^iL ^^[H . Sfl^Rr ^iL^ 7l#tr4. 
High light Segment DS^ & 7 fl^ tiji^^zL^E o^;*]^ 7l#^-S (VideoSegmentLocator 
DS)(205)4 ^ Hl^r 7fl<^ 7l^S (ImageLocator DS)(206), H^JL 

<3 BE-fe- 4^ 7]]^ ^ 3*1*1^ 7]^S (SoundLocator DS)(207), ^ln^M 
^1*1^ 7l#^-S(AudioSegmentLocator DS)(208)S ¥^€4. • .seraw 

°1*HHtt °] 7}]#^.2.^ 71#^S<>1] tflsfl £4 ^H^Tfl ^^^}7lS tr4. 

7l#^2:(HierarchicalSummary DS)^ Hierarchical Summary DS7 r S.^} 
^ Mi- 44^ tt -&-^4 0 J iH(SiimmaryComponentTypeLi st )4fe 4^ 

(attribute)^: ^4. 5} i§ (SummaryComponentTypeList)^ -S-^4^ 

(SummaryComponentType)^- 7]wVA5. *H 4^^, £1HeI SummaryComponentType 
^ 4H*H 7l#tr4. 

SummaryComponentType°ll^- keyFrames, keyVideoClips, keyAudioCl ips, keyEvents, 
unconstrained^ 5f^7> &4. keyFrames^- =^1 0 J^ keyFrames -S-^ 
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keyVideoClips^ ^J8. %Tt±3. ^€ keyVi-deoCl ips 

^ M-^iflJL, keyEventsfe 4^ tMH Sfl^rfe ^^5. .a.^ 

M-El-vflul, keyAudioClipsfe tfls -2.^-2. ^^S..^^ keyAudioCl ips &.9f 

^ M-El-^rf. unconstrained^ -#7]^r o]«q^ A>-g-^> 7 } ^S]^ -3-<^§- ^ 

<42> 7j]^^^_ot 7l^^2:(HierarchicalSunimary DS)fe f^s] ^oKg. 7 ]^^, 

- 71 if-^l a>^(je^ ^Ml )t~i- M-I^Kn =l ID1- 7l#^ Jl<>HMl£);i 

— 7l#^(SummaryThemeList DS)# £ft ^£ ^4. 
<43> SummaryThemeList SummaryTheme^t- £-± (element )S 
■..^measft-«eai SummaryTheme^r ID U(type)5] id^fe gJL parent IdHffe ^-i- ^i^^AS. # 

- fetf. 

<44> SummaryThemeList DS^ * r -g-*}7r SummaryThemeList^] 7]#^ ^ 7> 

\ 

^1 SL^ 4£ igS. ti^-o.^^- ^ olTfl *>Cf. 7)^ cflolEil- <^«Rr -§--g- 

1-^: SummaryThemeList DS1- parsing^} 0 } °1 ^>-8-^H>D *IW «H A r-§-*r7 r € 

^ iMlt- -id^l: ^ &7fl °H ^M]# ^Efl^. ^-f , ^ 

^r7> &0_£ ^*Kr ^*H# #7l7> -g-oj^xl ^ olcf. 

<45> nj-e^-Al ^^11- ToCCTable of Content)^ -B-a>^ Tree , 4-g-^f 

*M SummaryTheme°n parent Id^ 4^3-°S ^ 01 E s 

tr4. °1 parentld £ Tree ^2:<M ^M|)S) id«- 3*1^4. 
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^-'^s] 7l ^^(Hierarchical Summary DS)^ ^r^-H SH^H^H 

7]^S(HighlightLevel DS)# , °1 ^H^H M 31^ 7l#^-2:^ _8..s|= til^t- 

^Izl^e 7l^S (High light Segment DS)1- Sf-^tf. 

HighlightLevel DSfe IDREFS H^l themeldsSf^ name °1 themelds 

tt HighlightLevel i S.^ 3.^ Highl ight Segment DS £tt W HighlightLevel 
DS^ *H HighlightLevel DS^l ^§-€ ^ ^ a>^^ id# ^^^r-fl, o] id ^ #7] 
SummaryThemeList DS^l 7)^s\o] £>rf. themelds^ 4^r7fl^ t 
^ $m4r ^^Br ^H^lS ^Izi^ho]] ^ M-^fe themeldsl- 

'#^-£1^ ^1^^- 

- Highl ight Segment DSfe *r4^ ujc]^. ^zl^e 7] #^-2: - 

(VideoSegmentLocator DS)4, ^ SEfe cf^ 7flS] <*|# ^^1^1^ 7]#^-2 (ImageLocator 
DS)4, SE^ ^q-S] ^ 7|#^-S(SoundLocator DS)4, SE^b ^Kf 

5] ^.r]^. 3*1*1^ 7l^2:(AudioSegment Locator DS)* 5Ef-*r4. 

<*)7H, VideoSegmentLocator DSb ^ ^^Hr «lr].2. ^z^e ^ 

^3- ^ ^ ^Hf ImageLocator DS^ zl al^S- ^Izl^ 

— ^1 4SL 5L3]°J^ HH^i ^j&t- 7l#*r4. SoundLocator DStt *fl^ 4 

tfls*]-^ -g-^ ^^-1- 7] #^4. AudioSegmentLocator DStt 
■I: ^*Rr -2-^.2. ^]ZL^j=<^ zjl^ ^ ^ ^ ^ 7>^11- 7l^^cf. 
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High light Segment DSfe- themelds g^^), ^ aH^M^ xflnnjE7j.. 

^•71 SummaryThemeList DS^] 7]#s} ^afl ^ o]± ^]o]] sfltg-s]-^ *]# 

SumraaryThemeList DS°il id* °l-g-*H 7] #^4. themelds^ 7fl^ a}?1-§- 

^R 1 !: ^ °lir ^oj^-oiE ^zl^^7> 4^2] sf-^§ ^ ojj^. 

*H 7]^2] A}£ 71^-5] jl^-g- 7)^ nfl A>^(££^ ^D^S. «1 .O ^n^E^. 7 \- • 
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